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Presence of recurrent and statistically significant unstable periodic orbits (UPOs) in time series obtained 
from biological systems are now routinely used as evidence for low dimensional chaos . Extracting accurate 
dynamical information from the detected UPO trajectories are vital for successful control strategies that either 
aim to stabilize the system near the fixed point or steer the system away from the periodic orbits. A hybrid UPO 
detection method from return maps that combines topological recurrence criterion, matrix fit algorithm and 
stringent criterion for fixed point location gives accurate and statistically significant UPOs even in the presence 
of significant noise. Geometry of the return map, frequency of UPOs visiting the same trajectory, length of 
the data set, strength of the noise and degree of nonstationarity affect the efficacy of the proposed method. 
Results suggest that establishing determinism from unambiguous UPO detection is often possible in short data 
sets with significant noise, but derived dynamical properties are rarely accurate and adequate for controlling the 
dynamics around these UPOs. A repeat chaos control experiment on epileptic hippocampal slices through more 
stringent control strategy and adaptive UPO tracking is reinterpreted in this context through simulation of similar 
control experiments on an analogous but stochastic computer model of epileptic brain slices. Reproduction of 
equivalent results suggests that far more stringent criteria are needed for linking apparent success of control in 
such experiments with possible determinism in the underlying dynamics. 

PACS numbers: 05.45.-a, 05.45.Gg, 05.45.Tp, 87.18.Bb.87.18.Sn, 87.19.La 
Keywords: Hippocampus, Epilepsy, Unstable periodic orbit 

Unstable periodic orbits (UPOs) analysis has now be¬ 
come an established tool for detecting determinism in bi¬ 
ological systems. If the system is truly deterministic, ac¬ 
curate UPO characteristics can be further used for appli¬ 
cation of control or anti control strategies with potential 
medical application. However, accurate biological time se¬ 
ries analysis for UPOs critically depend on the length of 
data set, strength of noise, type of geometry, nonstation¬ 
arity etc. In this work we show that it is possible to es¬ 
tablish determinism through UPO analysis in presence of 
all these factors. However, the inaccuracy in the measured 
UPO parameters and non-stationarity nature of biological 
systems mean only adaptive control strategies are useful 
for successful chaos control in such systems. At the same 
time, comparable success of adaptive control strategies on 
a stochastic neural network model of epileptic slices de¬ 
mand more stringent criteria for linking adaptive control 
success with determinism. 


I. INTRODUCTION 

Chaos control—a method for maintaining periodic dynam¬ 
ics in chaotic systems—has received considerable attention 
following successful experimental demonstration in physical, 
chemical and biological systems 0. Applications of chaos 
control techniques jj, til in neural dynamics, mainly due to 
its possible medical applications in the treatment of epilepsy 
[ 0 ], have also been explored for some time. A number of anti¬ 
control of chaos methods have also been developed for this 
purpose M- Establishing the occurrence of deterministic 
chaos in epilepsy is of fundamental importance. Along with 
the possibility of understanding the underlying neuronal dy¬ 


namics lUMl it a ls° opens the possibility of short term pre¬ 
diction and control that has potential medical applications. 

The first experimental demonstration of chaos control in 
epilepsy on spontaneously bursting epileptic hippocampal 
slices by Schiff et al. 0] has triggered most of the re¬ 
search activity in this direction. In this experiment, occur¬ 
rence of recurrent unstable periodic orbits (UPOs) like trajec¬ 
tories and apparent success of chaos control based on these 
trajectories were interpreted as evidence for chaotic dynam¬ 
ics. This was immediately challenged with application of the 
same method with comparable success on a noise driven non- 
chaotic FitzHugh-Nagumo neuronal model [14]. To resolve 
this, new surrogate time series analysis techniques were de¬ 
veloped fl 514 171] for both searching the UPOs in a time series 
and for assigning statistical significance to them. Application 
of this method on the inter burst interval (IBI) data sets from 
brain slices [01 and on human epileptic electroencephalogram 
(EEG) for statisticall y sig nificant UPOs reported clear evi¬ 
dence of determinism fl8l1 . However, a rigorous simulation of 
the chaos control experiment on a stochastic neural network 
model for epileptic brain slices could also successfully repro¬ 
duce most of the observations reported in the experimental 
study by Schiff et al. [0. The surrogate methods for sta¬ 
tistically significant UPOs, when applied to stochastic burst 
intervals obtained from this computer model, also produced 
results [25 comparable to those reported earlier ifThLlHil l. Due 
to these conflicting results, the issue of unambiguously estab¬ 
lishing deterministic chaos in epilepsy based on statistically 
significant UPOs remained inconclusive. 

The chaos control experiment on epileptic hippocampal 
slices has been subsequently repeated by Slutzky et al. N2 1 1 — 
l23ll adopting more stringent UPOs detection method [0] along 
with a more robust adaptive chaos control technique l(24ll . 
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Successful chaos control, as well as statistically significant 
UPO analysis of the time series from this experiment claim to 
re-establish the original conclusions of low dimensional de¬ 
terministic chaos in epileptic brain slices. Various other meth¬ 
ods have been developed to distinguish between deterministic 
chaos and noise 125142911 and applied to EEG data to detect 
seizure & These positive and promising results, however, 
have not lead to any real application so far. This is because 
strong skepticism continues to persist on the two main issues: 

- whether the apparent UPOs in epileptic EEG truly orig¬ 
inate from an underlying deterministic dynamics that 
can be reconstructed or used, and 

- whether the apparent success of any control strategy us¬ 
ing the reconstructed dynamics can be conclusively in¬ 
terpreted as due to the deterministic nature of the under¬ 
lying dynamics. 

The difficulties in providing a clear and convincing an¬ 
swer to these two issues in the context of epilepsy are nu¬ 
merous.The underlying dynamics of an epileptic brain slice 
is unknown and high-dimensional, even the smallest of brain 
slices contain tens of thousands of neurons, whereas the ap¬ 
plied tools of non-linear dynamics and deterministic chaos 
were only proven on low dimensional known chaotic systems. 

The chaos control experiments are based on UPOs extracted 
from short inter burst intervals (IBIs). The apparent geome¬ 
try visible in the return maps of truly chaotic systems is ab¬ 
sent in the return maps of the epileptic IBIs in all the reported 
works. Interspike time intervals from rat facial cold recep¬ 
tor for which statistical significant UPOs are established show 
return map geometry consistent with UPO trajectories |30]. 
However, no such geometry is visible for interburst intervals 
data from epileptic hippocampal slices 00. Traditional 
surrogate analysis to assess statistical significance of UPOs in 
such return maps have provided mixed results lfl7l - fl9ll . New 
surrogate method that preserves the attractor shape in the shuf¬ 
fled surrogates have been found to be more suitable in such 
time series analysis for UPO detection 0- Even if the ap¬ 
parent recurrent UPO like trajectories truly originate from an 
underlying deterministic dynamics, how reliable are the fixed 
point, stable and unstable manifolds derived from this small 
number of short sequences from these noisy return maps with 
no apparent geometry? The lack of geometry could also be 
due to noise and it is claimed that presence of chaos can still 
be concluded if the observed UPOs are recurrent and statisti¬ 
cally significant. However, recurrent UPOs with similar statis¬ 
tical significance have been reported from IBIs from stochas¬ 
tic neuron models as well 111 411 . Analysis of biological time 
series and EEG data for seizure like activity and its suppres¬ 
sion have been done using tools other than UPO analysis also 

asm. 

A clear distinction based on the underlying dynamics must 
exist between the periodic dynamics of a system under chaos 
control and one induced by periodic pacing or demand pacing. 
The response of a brain slice to external stimulation is largely 
unknown and different from a physical systems. Further, fre¬ 
quent external stimulation can cause permanent change in the 


underlying dynamics or in the system parameters. This is ev¬ 
ident from a recent experiment showing control of seizures 
through electrical stimuli 0 Therefore, it is necessary to 
show that the periodic dynamics under chaos control is not 
due to any kind of biological synchronization with the exter¬ 
nal stimuli. 

Although the original chaos control experiment 0] as¬ 
sumed recurrent UPOs around the same trajectory as signature 
of determinism and chaos control was based on equation of 
manifolds derived from multiple UPO trajectories in the return 
map of IBIs, subsequent surrogate analysis have concluded 
presence of statistically significant ”non-stationarity or drift¬ 
ing” UPOs from rat hippocampal slices Si. To ensure 
successful chaos control, even around such drifting UPOs, 
adaptive chaos control techniques have been proposed 0- 
Adaptive chaos control using more stringent UPO detection 
technique have been proposed | 24tl and applied successfully 
in a re pea t chaos control experiment in epileptic hippocampal 
slices [21!]. 

The experiment of Slutzky et al. 0 provides valuable 
new insight and addresses some of these issues afresh, but a 
number of questions still remain. In this paper,we attempt to 
answer some of these questions by computer simulation of 
this adaptive chaos control experiment on a stochastic neural 
network model for the epileptic brain slices. The general ques¬ 
tion of deterministic chaos in neural systems is a vast field of 
research and this work focuses only on the reliability of UPO 
based chaos control applications in epileptic brain slices and 
the conclusions drawn from them. In the concluding section 
we summarize the main unresolved questions that prevent us 
from unambiguously establishing that the bursting in epilep¬ 
tic brain slices is chaotic dynamics in presence of noise rather 
than stochastic in origin. 


II. DETERMINISM FROM UPOS 

According to the cyclic theory of Chaos, chaotic dynam¬ 
ics is built upon ’’skeleton” formed by UPOs l33il . Due to 
ergodicity, the system visits these UPOs along stable mani¬ 
fold and departs away from it along unstable manifold. How¬ 
ever, time series analysis methods that chose the detection 
of these statistically significant UPOs as a criterion for es¬ 
tablishing deterministic chaos are more recent. A number 
of different techniques for search of UPOs in time series ob¬ 
tained from both low dimensional and high dimensional sys¬ 
tems have been proposed Il4l |15L I24l 134143711 and subsequently 
applied to time series from phy siological and biological sys¬ 
tems 0 0 0 G1 0 Si 0 El 0. Most of these 
methods adopt surrogate methods to establish the statistical 
significance of the detected UPOs. 

In an earlier work 0, the topological recurrence method 
0 was found to unambiguously reject short stochastic time 
series as non-chaotic when other methods erroneously found 
statistically significant UPOs in them. All methods tend 
to accurately discriminate chaotic and non-chaotic time se¬ 
ries when data sets were sufficiently large (datasets of size 
> 4096). However, results from shorter data sets were not 
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reliable. Among various UPO detection methods, the topo¬ 
logical recurrence method is the simplest and used regularly 
in analyzing biological time series although length of biolog¬ 
ical time series are usually small. Therefore, a rigorous anal¬ 
ysis of the reliability of this geometric method in the context 
of length of data set, level of noise, nature of geometry and 
nonstationarity is necessary because each of these affects the 
geometry of the return map and, therefore, likely to affect the 
results. 


A. Characterizing UPOs 


K = 


(N - N s ) 

Vs 


(1) 


defines the statistical significance of the observed UPOs. Here 
N is the number of successful UPO encounters in the original 
data, N s is the average number of successful UPO encounters 
in the surrogate data set, and a s is the standard deviation of 
the number of observed UPOs in the surrogate data. K > 3 
signifies a statistical confidence level of more than 99% in 
rejecting the null hypothesis that the data originated from a 
random process |35(|. 


The topological recurrence method for detection of UPOs 
adopts three levels of filtering to encounter UPO trajectories 
from the return map of a dynamics I34.;35. 391. 

• Level 0: Out of five sequential points, first three ap¬ 
proach the identity line with decreasing perpendicular 
distance and the last three depart from the identity line 
with increasing perpendicular distance. 

• Level 1: Linear least square fit to the first three points 
must have a slope in the range |A S | < 1 identifying 
a stable manifold and linear least square fit to the last 
three points must have a slope in the range — 1 > X us > 
—oo identifying an unstable manifold. 

• Level 2: Distance of the fixed point (estimated from the 
intersection point of the two straight line fits in the pre¬ 
vious step) from the identity line must be less than or 
equal to -Z times the average perpendicular distance of 
the five data points from the identity line. 

Although Level 0 and Level 1 are based on the defining ge¬ 
ometric properties of the UPOs, the Level 2 criterion was ad- 
hoc, and has been used differently in different applications 
lf38ll40h . The Level 1 criterion in [35] only included the slope 
condition for ’’flip” saddles. If the linear fits in Level 1 truly 
represent the stable and unstable manifolds, their intersection 
would lie on the identity line at the fixed point. In noisy 
data sets this condition may not be met exactly. Therefore, 
in Level 2, a relaxed criterion is adopted to discriminate can¬ 
didate UPO trajectories from the spurious ones. We have gen¬ 
eralized the Level 2 criterion to arbitrary m, where as the orig¬ 
inal criterion [35] was defined for m = 2. Higher m would 
demand the estimated fixed point (the intersection point) to 
be more closer to the identity line. Although this is expected 
to give more accurate UPO parameters, there will be lesser 
number of candidate UPO trajectories. 


B. Statistical significance of UPOs 

To determine whether the detected UPOs actually originate 
from deterministic and not from stochastic dynamics, surro¬ 
gate analysis methods have been proposed lfl5ll30l 13413511411] 
. In the topological recurrence method [35], the K value 


C. Results 

We applied the topological recurrence method to estimate 
dynamical parameters by looking for candidate UPOs in the 
first return map of three known deterministic chaotic systems, 
each having a different geometry. We then compared the 
estimated UPO characteristics with the true values. Depen¬ 
dence on the effect of noise, length of data sets and nature 
of geometry on the estimation of dynamical parameters are 
studied in detail. For each data set, at each level of filtering, 
a number of candidate UPOs are obtained. For each of these 
trajectories, the three parameters characterizing the UPO 
trajectories (A s , \ us , and the fixed point) are determined. 
Statistical fluctuations of the estimated dynamical parameters 
are analyzed by measuring the mode and the range (difference 
between maximum and minimum values). This is done for 
different levels of noise, different lengths of data sets, and 
different levels of filtering. 

The three systems being studied are : Henon map, Ikeda map 
and Rossler attractor. The dynamics of Henon map is de¬ 
scribed by 

Xn+1 = 1 + bY n — aXn, 

Y n+1 = X n + eZ , (2) 

where a=1.2, b=0.3, and e denotes strength of the dynamical 
noise. Z is a uniform random variable in the range [-1,1]. 
For these set of parameter values and e = 0, the true values 
characterizing the UPOs are: A. s = 0.178, X us = —1.69, and 
fixed point at X* = 0.6667 lf39il . 

Henon map has been analyzed earlier using only the Level 0 
topological recurrence method combined with a matrix fit al¬ 
gorithm l39ll . The dynamical parameters were estimated and 
analyzed with or without noise. In this work we try to under¬ 
stand the deviation of estimated results from actual values in 
the presence of noise, its dependence on length of data sets 
as well as its dependence on the nature of the geometry. At 
each Level, a number of candidate UPO trajectories are ob¬ 
served and dynamical parameters are computed from linear 
fits to these trajectories. These results are summarized in Ta¬ 
ble 1. 

In absence of noise, mode of the estimated dynamical pa¬ 
rameters is nearly the same for different levels of filtering. 
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Noise 

Level 

A 


A 

Li 

X 

* 



mode 

range 

mode 

range 

mode 

range 


0 

0.2576 

1.2572 

-1.7850 

1.7006 

0.6701 

0.6752 

0.0 

1 

0.2576 

1.2572 

-1.7850 

0.8289 

0.6747 

0.5906 


2 (m=2) 

0.2548 

1.2201 

-1.7950 

0.8276 

0.6724 

0.4908 


2 (m=5) 

0.2560 

1.2189 

-1.7986 

0.8206 

0.6730 

0.4893 


2 (m=10) 

0.2550 

1.2198 

-1.7974 

0.7993 

0.6736 

0.4294 


0 

-0.5533 

1.4589 

-1.7798 

12.089 

0.6556 

1.5305 

0.1 

1 

-0.5533 

1.4589 

-1.7798 

6.3346 

0.6556 

1.5305 


2 (m=2) 

0.2271 

1.4584 

-1.7998 

6.3346 

0.6591 

0.5071 


2 (m=5) 

0.2374 

1.4336 

-1.800 

3.6838 

0.6618 

0.5145 


2 (m=10) 

0.2397 

1.3819 

-1.7751 

6.3288 

0.6710 

0.5024 


0 

-0.5588 

1.5661 

-1.7832 

13.7858 

0.6522 

1.5507 

0.2 

1 

-0.5688 

1.5097 

-1.7832 

10.178 

0.6521 

1.5507 


2 (m=2) 

0.2312 

1.5097 

-1.7832 

10.173 

0.6544 

0.5658 


2 (m=5) 

0.2380 

1.4797 

-1.8197 

4.3313 

0.6700 

0.5263 


2 (m=10) 

0.2490 

1.4092 

-1.7850 

8.5878 

0.6755 

0.5122 


TABLE I: Manifolds and fixed point estimate using topological recurrence criteria from 50 ensembles 4096 point dataset of Henon map 
(Actual As, \u, x* are 0.178, -1.69 and 0.6667 respectively.) 


This has been observed earlier also (39]. In absence of noise. 
Level 0 is adequate for the purpose of establishing statistically 
significant UPO detection. Range of the estimated parameter 
values decreases as the filtering criteria is made more strin¬ 
gent, i.e., as one goes from Level 0 to Level 2. In presence 
of noise, the geometry of the return map also gets noisy. As 
expected, this leads to inaccurate estimate as well as increase 
in the values of range. The value of the mode for the stable 
manifold estimates for Level 0 and Level 1 filtering criteria de¬ 
viates significantly from the mode of Level 2 estimated values, 
although the secondary peak is nearly the same as the mode of 
Level 2 estimate. This signifies occassional failure of Level 0 
and Level 1 criteria in the presence of noise. Also, the mode of 
stable manifold estimates is nearly 40-50 % more than the true 
value, while the deviations in the mode of unstable manifolds 
and fixed point estimates are less than 10%. We have added 
a further filter in Level 2, i.e., the value of to. The results 
presented in Fig. ?? are for m = 2 and those summarized in 
Table 1 are for m = 2, 5 and 10. Increasing to does not lead 
to significant improvement in the UPO parameters, but the 
number of candidate UPO trajectories decreases significantly. 
With increasing m, K-value remains nearly identical for small 
datasets and increases for large datasets with or without noise 
as shown in Fig. 0 

Surprisingly, while the variations in UPO parameter esti¬ 
mates increase with noise, no significant change is observed 
in the K-statistics shown in Fig. [3 This means that the topo¬ 
logical recurrence method is fairly robust in establishing de¬ 
terminism in the presence of moderate noise in data sets of 
moderate length (data size > 1024). For the same length 
data set, the number of candidate UPOs detected at each level 
decreases with increase in strength of noise. Unchanged K- 
statistics indicates that the number of candidate UPOs de¬ 
tected in the surrogate data sets also decreases. 


To understand how the topological recurrence method de¬ 
pends on the type of geometry in the return map of the dynam¬ 
ical system, two other systems are also analyzed. The Ikeda 
map is described by 

t n = a — 6/(1 + X* + Y^), 

X n+1 = 1 - uX n cos(t n ) - uY n sin(t n ) + ez 1; 

Y n+ 1 = uX n sin(t n ) + uY n cos(t n ) + ez 2 , (3) 

where a = 0.4,6 = 6.0, u = 0.9. For these set of param¬ 
eter values, the fixed point is 1.0550, the slope of the stable 
manifold is 0.6634 and the slope of the unstable manifold is 
— 1.221 [42]. e denotes strength of dynamical noise, z\ and z-i 
are uniform random variables in the range [-1,1]. The data for 
X are analyzed for UPOs using topological recurrence crite¬ 
ria. In absence of noise, the mode of all the three estimated pa¬ 
rameters improve significantly as the filtering criteria is made 
more stringent. However, stable manifold estimate deviates 
significantly from the actual value even for Level 2 filtering 
(mode is 0.070592 and range is 0.6930 for 50 datasets of 
length 4096). In absence of noise, out of 50 data sets of size 
4096 each, only 35 give successful UPO candidates at Level 
2, out of which 17 data sets give just one successful UPO can¬ 
didate. In presence of noise, the fixed point estimate deviate 
from true value by 10% for Level 2 filtering (for e = 0.2). Un¬ 
stable manifold estimates deviate by 20 % for different levels 
of filtering with or without noise. With addition of noise, there 
is uniform increase in the range of all estimates indicating 
greater deviations from actual parameter values. When dy¬ 
namical noise is introduced, 42 data sets give successful UPO 
candidate at Level 2 out of which 15 data sets have just one 
successful candidate UPO. This indicates that for this geom¬ 
etry, the system dynamics do not visit close to the fixed point 
frequently and the estimated parameters deviate significantly 
from true values because of this reason. 
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FIG. 1: UPO analysis of Henon map (X n +i vs. X n ) without noise using topological recurrence criterion, (a) Actual return map, (b) Level 0 
filtered, (c) Level 1 filtered and (d) Level 2 filtered UPO trajectories respectively. 


The Rossler attractor is a continuous time dynamical sys¬ 
tem described by 

x = -(y + z), 

y = x + ay , 

z = b + z(x — c) + y/2 DE(t), (4) 

where E(f) is gaussian white noise with zero mean and unit 
variance. D is the amplitude of dynamical noise. The values 
of the parameters are a = 0.2, b = 0.2, and c = 5.7. From 
X=0 plane Poincare section is obtained and the variable y is 
used for further analysis |39j. The actual fixed point, stable 
manifold and unstable manifold are —8.39, —2.34x 10 - ' and 
—2.40 respectively. 

For this system, the topological recurrence criteria shows 
strong dependence on the geometry of the Poincare section. 
In absence of noise, the mode of the estimates of A s vary with 
each level of filter (—0.571 with a range of 0.9649 for both 
Level 0 and Level 1, and —0.025129 with a range of 0.58709 
for Level 2). These estimates are significantly different from 
the actual values. It appears that the method fails because A s 
is close to zero. Unstable manifold estimates for Level 0 and 
Level 1 filtering are close to actual value ( mode is —2.1133 
and range is nearly 2.0), but deviates significantly from the 
actual value for Level 2 ( mode is —1.1049 with range 0.6406). 
Fixed point estimates are fairly accurate for Level 2 filtering 
criteria ( mode is —8.4314 with range of 0.94955). For this 


geometry, the estimates do not deteriorate much with intro¬ 
duction of noise, although the variability increases marginally. 
In absence of noise, out of 50 data sets of size 4096, 16 data 
sets give successful UPO candidates at Level 2 filtering, out 
of which 13 data sets have just one successful candidate UPO, 
the reason for large deviation in stable and unstable manifold. 
Similar results are obtained when dynamical noise is intro¬ 
duced in the system. Above observations show that geomet¬ 
rical structure greatly influences the frequency of UPO visit 
as well as the accuracy in the estimation of dynamical pa¬ 
rameters. However, the statistical significance of the UPOs 
assessed at all levels of noise is above 95%. The topological 
recurrence method is robust in establishing all these systems 
to be deterministic even in the presence of moderate noise. 
Large values of m signifies close visit to UPOs. For Henon 
map, UPO candidates satisfying conditions for higher m are 
easily obtained, while for Ikeda map and Rossler attractor, 
even UPO candidates satisfying m = 2 criteria is not found 
frequently. This means that choice of m value to improve UPO 
detection will depend on the system under investigation. 

In the above analysis, random shuffled surrogates were 
used. It has been pointed out that random surrogates that pre¬ 
serve the attractor shape are more appropriate 0. From, 
the results of the surrogate analysis of Henon map using sur¬ 
rogates that preserve attractor shape, it is observed that K- 
statistics for Level 0 is similar to that of shuffled surrogates 
for different strength of noise and length of data sets. No can- 
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FIG. 2: UPO analysis of Henon map (X n +i vs. X n ) with noise (e = 0.2) using topological recurrence criterion, (a) Actual return map, (b) 
Level 0 filtered, (c) Level 1 filtered and (d) Level 2 filtered UPO trajectories respectively. 


didate UPO was found for Level 1 and Level 2 for data sets 
of length less than 16384. For data set of length 16384 and 
m = 2, Level 1 and Level 2 statistical significance is > 99 
%. As noise is added, K-statistics value decreases for Level 
1 and Level 2. Similar results are obtained for m = 5 and 
m = 10. As m is increased, K-value for Level 0 increases 
while it decreases for Level 1 and Level 2. We observe that for 
systems with deterministic geometry, the random surrogates 
that preserve attractor shape are less likely to have candidate 
UPOs, resulting in higher K-statistics. However, if the return 
map does not have any visible geometry, the attractor shape 
preserving surrogates do not improve statistical tests signifi¬ 
cantly. 

These results suggest that the UPO parameter estimates are 
good when the system dynamics repeatedly visits very close 
to the UPOs. With increase in the length of data sets, num¬ 
ber of visits as well as number of close encounters with UPOs 
increase yielding very good estimates of the fixed point and 
slopes of the stable and unstable manifolds. Close encounter 
with UPOs and accuracy of dynamical parameter estimation 
depends strongly on geometrical structure. The statistical sig¬ 
nificance of UPO detection is above 95% for the diverse cases 
examined indicating this to be a general result. As noise 
level is increased, smearing of the UPO structure takes place 
and manifold estimates deteriorate, although statistical signif¬ 
icance remains high. With small length of data sets and high 
level of noise, obtaining statistically significant result depends 


on the frequency of UPO visits, which in turn depends on the 
geometry of the return map. There is a decrease in number of 
successful encounters at each level. We also observe that the 
UPO parameters do not improve significantly by increasing 
to. Increasing m is analogous to looking for close encounters 
to UPOs, which results in decrease in number of successful 
encounters. Even at low level of noise and for long data sets, 
the estimated UPO parameter values are not accurate enough 
for control applications. Another crucial observation is that 
the method works well for the dynamics where the third point 
of the candidate UPOs is actually close to the fixed point. The 
topological recurrence criteria assumes that this point belongs 
to both the stable and the unstable manifold. 


D. Modified UPOs selection criterion using dynamical 
transformation method 

The results and analysis presented in the previous section 
point to two major shortcomings of the topological recurrence 
criteria. The fixed point estimate as determined from the in¬ 
tersection of the linear fits to the approaching and receding set 
of points is inaccurate. The requirement that the fixed point 
need to be close to the identity line rather than a specific point 
on the identity line introduces additional error. 

Instead of using least square fit, we adopt a method used by 
Dolan 139] to obtain estimates of fixed point and manifolds. 
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FIG. 3: Statistical significance of UPO analysis of Henon map (K vs. 
n) using topological recurrence criterion: ((a) without noise, (b) with 
noise e = 0.2 for different levels of filtering, (c) Level 2 statistics for 
different value of m without noise e = 0.0, (d) Level 2 statistics for 
different values of m with noise e = 0.2). 


In the vicinity of UPO, system dynamics is approximated as 

X n+1 = AX n + BX n . x + C. (5) 

The Level 0 criterion gives five consecutive points defining 
the UPO trajectory near the fixed point. Slopes of the mani¬ 
folds and the fixed point of the detected UPOs were obtained 
by solving the three simultaneous linear equations obtained 
from the three triplets of the candidate UPO trajectory [39]. 
This gives significantly improved result than the least square 
method of Level 1. Instead of the average distance from the 
identity line criterion in Level 2, we use a new criterion that 
uses the So et al. fl5ll method of dynamical transformation 
that gives very good estimate of period 1 fixed point even in 
presence of noise. We redefine the Level 2 criterion as 


Level 2 : <= <5, (6) 

X 2 

where x* 2 is the fixed point estimate from dynamical transfor¬ 
mation method (151, and x\ is the fixed point estimate from 
Level 1 using Eqn. 0 S is a measure of close encounter with 
UPOs. 

The results from this hybrid method that combines the orig¬ 
inal topological recurrence criterion |[35j] with the matrix fit 
algorithm [39] and dynamical transformation method El for 
the Henon map are presented in Table 2. Adopting the matrix 
fit algorithm Eqn. 0 gives different values for the fixed point 
and the slopes of the manifolds than the original topological 
recurrence criterion. There is significant improvement in the 
accuracy of the UPO parameters compared to the results from 
the topological recurrence criterion summarized in Table 1. 


Values of S used for Henon map are 0.001, 0.005 and 0.005 
for the noise values 0.00, 0.10 and 0.20 respectively. With 
or without noise, estimates approach the actual values as fil¬ 
tering is made more stringent. Estimates of stable manifolds 
deviate by 5% to 10% as noise varies from 0.0 to 0.2. The es¬ 
timates of the unstable manifold deviate from 6% to 15% for 
the same noise variation. At Level 2, the fixed point estimates 
are accurate up to 0.5% for these noise values. For all the 
three parameter estimates, results for Level 0 and Level 1 are 
identical for noise level 0.0 and 0.1, while for noise 0.2, there 
is marginal variation only in the stable manifold estimate. 

Values of S used for Rossler attractor are 0.001, 0.005 
and 0.005 for the noise values 0.00, 0.10 and 0.20 respec¬ 
tively. Results for the stable manifold estimates at Level 2 
are -0.01648, -0.02275, -0.01989 for D = 0.0, 0.1, 0.2 re¬ 
spectively, showing large deviation from the true value. This 
is due to the small magnitude of the slope of the actual stable 
manifold. Results for the unstable manifold and fixed points, 
for different levels of filtering and strength of noises, are iden¬ 
tical with accuracy up to 12% and 1% respectively. Results for 
Level 0 and Level 1 are identical for strength of noise varying 
from 0.0 to 0.2 for all the three parameter estimates. 

For Ikeda map, value of S = 0.1 is used for three noise 
values 0.00, 0.10 and 0.20. For Level 2 filtering, fixed point 
estimates deviate up to 3% for different strengths of noise. 
Result for unstable manifold differs by 50% for noise 0.0 and 
0.1, and by 70% for noise 0.2. Estimates of stable manifold 
differs by 50% for Level 2 filtering (for different strengths of 
noise). Results of Level 0 and Level 1 are not identical as is 
observed in case of Henon map and Rossler attractor. 

The results at Level 0 and Level 1 filter are not close to ac¬ 
tual UPO parameters for the three systems studied. Otherwise, 
UPO parameters at the end of Level 2 of the hybrid method 
are very close to the actual values except for the Ikeda map. 
Comparing the results from the three systems analyzed in this 
work, we find that with matrix fit algorithm, only a very small 
fraction of the UPOs detected in Level 0 are rejected at the 
next level of filter Level 1. The Level 2 filter is more stringent 
and is the reason behind very accurate parameter estimation 
even in the presence of moderate noise. This hybrid method 
works better than the topological recurrence method. Better 
parameter estimation results from adoption of a more accu¬ 
rate fixed point in Level 2. Close encounter with UPOs can 
be adjusted depending on the geometrical structure. If 5 value 
is large, stable and unstable manifold estimate won’t be good 
but fixed point estimate will be good, which is primarily due 
to the inclusion of the dynamical transformation method. 


m. CHAOS CONTROL USING ADAPTIVE UPO 
TRACKING 


Results of previous section suggest that unambiguous de¬ 
tection of UPOs is often possible in short and noisy biologi¬ 
cal time series through topological recurrence criteria. How¬ 
ever, we also observe that estimation of quantitative param¬ 
eters characterizing the UPOs deteriorate rapidly with addi¬ 
tion of noise. In this context, it is important to reinterpret 
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Noise 

Level 

A 


A u 

X 

* 



mode 

range 

mode 

range 

mode 

range 


0 

0.1064 

0.8919 

-1.7929 

0.8361 

0.6467 

0.3764 

0.0 

1 

0.1064 

0.8919 

-1.7929 

0.8361 

0.6467 

0.3764 


2 

0.1698 

0.0562 

-1.7740 

0.0656 

0.6709 

0.0012 


0 

0.1428 

7.6847 

-1.7719 

10.417 

0.6593 

0.4338 

0.1 

1 

0.1428 

1.724 

-1.7719 

9.4743 

0.6593 

0.4338 


2 

0.1867 

0.6547 

-1.8431 

0.8908 

0.67014 

0.0013 


0 

0.1432 

12.766 

-1.7008 

20.417 

0.6512 

1.8558 

0.2 

1 

0.1294 

1.9708 

-1.7008 

18.931 

0.6512 

1.8558 


2 

0.1832 

0.9965 

-1.9436 

1.5517 

0.6696 

0.0013 


TABLE II: Manifolds and fixed point estimate using modified Pei-Moss criterion from 50 ensembles 4096 point data set of Henon map (Actual 
A s , X u , x* are 0.178, -1.69 and 0.6667 respectively.) 


control strategies reported to be successful and carefully re¬ 
design such experiments in future. This is why the determin¬ 
istic interpretation of the original chaos control experiment on 
epileptic brain slices was questioned earlier IU4i 119(1 . 

The results and analysis presented in the previous section 
show the unreliability of the UPO parameters obtained from 
return maps with noisy geometry even when the data is from 
known deterministic dynamics. Return maps plotted from bi¬ 
ological time series invariably lack any noticeable geometry 
0,|2lt]. Although chaos control is an efficient tool for con¬ 
fining system dynamics to any of the periodic orbits by suit¬ 
able intervention at appropriate times, reliable estimation of 
fixed point, slope of manifolds and nonstationarity pose tough 
challenge for good chaos control. To understand the apparent 
success of the repeat chaos control experiment on epileptic 
brain slices by Slutzky et al. ll2ll - [23ll . it is necessary to first 
judge if the apparent success unambiguously originate from 
the underlying deterministic dynamics and made possible be¬ 
cause of the adoption of more stringent detection and con¬ 
trol strategies. We first examine the efficacy of the adaptive 
UPO tracking along with stable manifold perturbation (SMP) 
method that is used to obtain good control results for Henon 
map (Eqnl3 in a known deterministic system [24|| • 

In the vicinity of UPOs, system dynamics can be approxi¬ 
mated by Eqn. 0 which can be written as 

X n +i = (A s 4- A u)X n \ s \u X n —\ 

+Af*(l + X S X U — As — An), 

where A s , A„ and X* are actual stable eigenvalue, unstable 
eigenvalue and fixed point respectively B24ll . Chaos control 
by stable manifold perturbation (SMP) is done through 

X n+1 =X s (X n -X*) + X *. (8) 

UPO parameters estimated using the hybrid topological re¬ 
currence criterion is used for initiating SMP and then system 
dynamics is allowed to evolve naturally. If the trajectories 
stay within a control region, no further perturbation is ap¬ 
plied. SMP is again applied when the system comes out of 
the control region. To do this, first natural triplets ( X n+ i , X n , 
X„_i), where X n+ i correspond to natural dynamics, are ob¬ 
tained. Least square fit using singular value decomposition 



n n 


FIG. 4: Adaptive control of Henon map (a) without noise, (b) with 
noise=0.005 


(SVD) is performed on a set of 10 natural triplets to obtain 
new estimates of stable manifold and fixed point [ 241. SMP is 
again applied using revised estimated values. The process is 
continued till the control cannot be improved further. 

In the absence of noise and nonstationarity, our UPO pa¬ 
rameter estimates improve with each iteration and approach 
the actual values. With accurate UPO parameter estimates, 
the control lasts for significant duration without needing any 
external intervention as shown in Fig. [4] However, with the 
addition of noise, accuracy of the UPO parameter estimates 
deteriorates and adaptive tracking fails at regular intervals. 
With no noise, control application was needed on an average 
every 14th iteration while with a small value of noise, con¬ 
trol application was needed every 7th iteration on an average. 
This signifies the difficulty of adaptively controlling a known 
deterministic system even in the presence of very low level of 
dynamical noise that does not alter the geometry of the return 
map appreciably 0. 

To re-examine the apparent success of the repeat chaos con¬ 
trol experiment on epileptic brain slices using the stringent 
adaptive tracking method mm, we repeat the procedure 
on a stochastic neural network model of epileptic brain slices 
0 l20h with same strategy. For completeness, a brief de¬ 
scription of this computer model for epileptic hippocampal 
slices 10 is presented below. The neural network consists of 
N McCulloch-Pitts (binary) neurons S, £ {0,1}, each exci- 
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tatory, where 0 and 1 represent the low and high firing rates 
respectively. The inhibitory neurons are collectively modelled 
by a background inhibition that is proportional to the number 
of active excitatory neurons. The “local field” at the ith neu¬ 
ron at time t is given by 


N 

h i{t) = Yy{ j a s A t )- ws i{ t )} 

j =i 

+\{KijSj(t - t) - wSj(t- r)}], (9) 

where w is the relative strength of inhibition, A is the relative 
strength of the delayed signal, and r is the time delay asso¬ 
ciated with the delayed signal. The four terms from left, fast 
global excitation, fast global inhibition, slow global excita¬ 
tion and slow global inhibition are essential (44) for a realis¬ 
tic modelling of neural oscillations in the hippocampus. The 
“time” t is discrete, with each unit (referred to as one “pass”) 
corresponding to the updating of N neurons. The neurons are 
updated one at a time in a random sequence, according to the 
rule: Si(t+1) = 1 if /t,(f) > 0 and S)(t+ 1) = 0 if hi(t ) < 0. 

A fixed number (q) of random low activity patterns (“mem¬ 
ories”) }, i = 1,2,. ,N\ [i = 1,2,., q, are stored in 

the synaptic matrices and K l3 as Jij = 0(X^=i £i£j) 
and Kij = 0(E^ =1 (f +1 ^) respectively. 0(x) = 

1(0) if x > 0(x < 0), £? +1 = and J u = K u = 0. 
Each memory contains n “active” neurons chosen randomly 
and n = « N ensures low average activity of 

the network in the absence of any external stimulus. Due to 
the properties of the synapses and with appropriate choice of 
other parameters (specifically, for A > 1 and w < 1), the 
network exhibits a low-activity limit cycle in which all the q 
memories are visited sequentially j 43il . In this work, the cho¬ 
sen parameter values are: N = 200, q = 20, n = 10, w = 
0.6, A = 2, r = 2 passes. 

The hippocampal brain slices used in the chaos control ex¬ 
periments were chemically kindled to generate epilepsy. This 
process is replicated in this computer model by reduced in¬ 
hibition (equivalent to excitation) accompanied with hebbian 
learning B430 . The network was excited by chosing w = 0.24 
for 50 initial passes during which new fast connections were 
created through a hebbian learning mechanism. Addition 
of these new connections generates spontaneous population 
bursting similar to the bistable dyanmics of epileptic bursts 
and it has been established that in this computer model of 
epileptic brain slices, the underlying dynamics of this epilep¬ 
tic bursts are stochastic in nature 112011 . 

Although this model with binary neurons and synapses may 
be inadequate for truly describing neurobiological dynamics 
of an hippocampal slice that depends crucially on the detailed 
biophysical properties of individual neurons, it incorporates 
a number of important neurobiological features of kindled 
brain slices. Networks of binary neurons can still qualitatively 
describe the collective dynamical behavior of biological net¬ 
works. In the context of this paper, however, this model is 
ideally suited for simulating the control experiments on com¬ 
puter similar to the real experiments on brain slices. Further, 
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FIG. 5: Stochastic neural network showing epileptic bursts (a) 
Smoothened activity and (b) Return map 


the proven stochastic nature of the bursting dynamics makes 
it a suitable surrogate model on which UPOs detection and 
adaptive chaos control experiments should be reasonably dif¬ 
ficult to reproduce with comparable success and qualitatively 
different from the real brain slices, if the bursting dynamics of 
the real biological systems were deterministic in nature. Typ¬ 
ical bursting dynamics and the first return maps of inter burst 
intervals (IBIs) from the computer model are shown in Fig. 0 
for completeness. 

Fixed point of the dynamics is estimated from the first re¬ 
turn map of the IBIs using dynamical transformation method 
of So et al. |J_5] and manifolds are estimated using modified 
UPO selection criterion. To apply control, fixed radius)A/.’) 
within which control has to be applied is fixed as well as 
the desired radius within which IBIs will be left unperturbed, 
called control radius(/ff). Control is switched on when cur¬ 
rent IBI lies in Rp and continued till the time it enters He 
El. Once we get inter-burst interval(IBI) within Rf, time of 
next IBI is calculated using 

Tn +1 = Xs(T n -fp) + f Pl (10) 

where T n is the time interval between n th and (n — 1 ) th IBI, 
A s is the slope of the stable manifold and fp is the fixed point. 
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experiment performed on actual biological network l2lll . This 
indicates that more stringent UPO detection or adaptive UPO 
control may not necessarily be the reason of successful chaos 
control in this experiment. This comparison also indicates 
that the true system and the stochastic neural network models 
can be discriminated through UPO analysis using topological 
recurrence criteria, but, the two systems cannot be discrimi¬ 
nated on the basis of the chaos control although one is clearly 
a stochastic system. 


FIG. 6: Effect of control radius Rc on (a) Variation of variance and 

(b) fraction of stimulated IBIs IV. DISCUSSION AND CONCLUSION 


If a burst is obtained before or up to the estimated time of 
burst, time for the next burst is calculated and the process is 
continued. Otherwise inhibition (ui) is reduced for next five 
passes to generate a stimulated burst [20]. 

It is found that as Rc is decreased, more and more number 
of control stimuli has to be applied and variance of IBIs de¬ 
creases Fig. [6] As Rp is decreased, lesser number of control 
stimuli has to be applied and variance of IBIs increases. To 
get quality control, both Rc and Rp value have to be opti¬ 
mized taking into consideration variance of IBIs. Quality of 
control is improved by adaptive tracking of UPOs. We use 10 
natural triplets to refine the value of fixed point and manifolds 
by least square fit method using singular value decomposition. 
Care is taken that, naturally terminated IBI must lie within a 
small radius (Rnt) from previous estimate of fixed point. To 
tackle the problem of fluctuations in the fixed point estimate, 
previous fixed point estimate is refined if and only if new es¬ 
timate lies within a small radius from the previous fixed point 
called, a process known as fixed point adjustment maximum 
(FAM)[21]. This process helps tackle the problem of non- 
stationarity. Control applications for different values of the 
control radii are shown in Fig. [7] It is observed that applica¬ 
tion of chaos control reduces the concentration of IBIs over 
and above the fixed point. The SMP control ensures exter¬ 
nal stimuli if the IBIs are above the fixed point because slope 
of the stable manifold is usually small. Therefore, lesser the 
concentration above fixed point, better is the quality of con¬ 
trol. Control achieved was good but deteriorated once adap¬ 
tive tracking was introduced as there is modification either to 
the stable eigenvalue or to the fixed point. Number of passes 
required to obtain desired number of IBIs decreases as control 
is applied. 

As control radius (Rc) is increased, the fraction of IBIs 
above the fixed point decreases and the fraction of Stimulated 
IBIs increases. As the strength of inhibition is reduced, less 
number of IBIs are simulated keeping other parameters con¬ 
stant. Decreasing concentration of points over and above fixed 
point requires more and more number of control stimuli, indi¬ 
cating equivalence of chaos control and demand pacing. Re¬ 
sult of our adaptive chaos control application on the stochas¬ 
tic neuron model of epileptic brain slice is shown in Fig. [7] 
Quality of control, effect of control radii on the variation of 
the variance and fraction of stimulated IBIs are found to be in 
very good agreement with the results of adaptive chaos control 


Nonlinear dynamics tools have been immensly useful in 
both the understanding of biological systems and specific con¬ 
trol applications in such systems. However, in biological sys¬ 
tems, applications of nonlinear time series analysis tools for 
establishing determinism have not been straightforward. This 
work addresses two specific but important issues in this con¬ 
text - establishing determinism through detection of statistical 
significant UPO trajectories in the return map of interspike 
or interburst intervals, and extracting parameters of the un¬ 
derlying chaotic dynamics for applications of chaos control. 
Although the issues and the results presented in this work are 
relevant for biological systems in general, the current study 
has focussed on epileptic systems in particular. 

Contrary to regular dynamical systems, biological time 
series are short, noisy, and nonstationary. We find that 
amongst all UPO detection methods, the topolological recur¬ 
rence method li33ll is most reliable for analysis of biological 
time series for determinism. It detects, with reasonable suc¬ 
cess, statistically significant UPOs in different known dynam¬ 
ical systems with different geometry and in presence of mod¬ 
erate noise. It is also observed that as long as the added noise 
does not significantly alter the shape of the attractor in the re¬ 
turn map, the method is found to be robust and applicable for 
datasizes exceeding 1000. However, the method was found 
to be not accurate in determining the fixed point of the de¬ 
tected UPO trajectory. This in turn affects the measurement of 
slopes of the stable and unstable manifolds. At the same time, 
a dynamical transformation method [ 15] is more accurate in 
determining the location of fixed point in the return map. We 
propose a new hybrid UPO detection method that combines 
topolological recurrence method for UPO trajectory, dynam¬ 
ical transformation for the fixed points, and matrix fit algo¬ 
rithm for slope of the manifolds and this gives statsitically 
significant UPO detection and much improved UPO parame¬ 
ters. For researchers analyzing biological time series, this can 
be a robust mothod for establishing determinism. This also 
establishes UPO detection as a viable tool for establishing de¬ 
terminism in moderate sized noisy biological time series, pro¬ 
vided appropriate surrogate analysis is adopted for determin¬ 
ing the statistical significance of the detected UPOs. Although 
the success of the method can be generalized to systems of dif¬ 
ferent attractor shape and geometry, the statistical significance 
of UPOs depend on the geometry of the UPO trajectory and 
the frequency of visiting the trajectory. 

The method does not, however, provide very accurate UPO 
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FIG. 7: Effect of control radius Rc and inhibition strength(w) on the adaptive chaos control of stochastic neural network for epileptic brain 
slices. Rnt=40, FAM=50, R f = 200 (a) w=0.12, R c =50, (b) w=0.12, R c =W0, (c) w=0.12, R c = 50, (d) w=0.06, R c = 50 


parameters for chaos control strategies. Our results, obtained 
from known dynamical systems with noise, suggest that even 
minor inaccuarcy in the UPO parameters makes the chaos 
control drift quickly, needing frequent external stimuli to keep 
the system near the targeted periodic orbit. The error is likely 
to become more serious if the system is nonstationarity. If the 
UPOs drift becuase of nonstationarity, the UPO trajectories 
are to be repeatedly assessed from short windows. The exist¬ 
ing methods are not reliable in determining UPO parameters 
from short data windows if noise is present. New adaptive 
methods have been proposed to overcome this. The repeat 
chaos control experiements conducted by Slutzky et al H2ll — 
|23l l reported to have achieved successful control by adopting 
stringent adaptive tracking and detection techniques. How¬ 
ever, our analysis demands a more careful examination of 
the procedure and interpretation of the reported control re¬ 
sults. Using a computer model of epileptic brain slices, the 
chaos control experiment is repeated using the same adaptive 
tracking method and produced comparable results. Since the 
epileptic bursts timings in the computer model is stochastic in 
nature, the comparable success casts doubt on the interpreta¬ 
tion of the results of the experiments on real system. Since 
the original system also needed frequent stimulus, the appli¬ 


cation strategy is similar to demand pacing, although chaos 
control strategy that exploits underlying deterministic dynam¬ 
ics ought to be significantly different from demand pacing. 

The results and analysis presented in this work may not be 
sufficient to conclude that determinism is positively absent in 
epileptic EEG. It simply means that for a sufficiently high di¬ 
mensional and noisy biological system such as the epileptic 
brain slice, the underlying dynamics, even if possibly deter¬ 
ministic, is difficult to unfold with the currently available non¬ 
linear dynamics tools. The underlying biological complex¬ 
ity and stochastic fluctuations make the task difficult. Never¬ 
theless, non linear time series analysis has been seen useful 
in analysis of such systems. Finding more useful complex¬ 
ity measures as well as developing more stringent dynamical 
tools to unambiguosly describe the dynamics of such biologi¬ 
cal system continue to remain a challenging task. 
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